Instability of nonlinear dispersive solitary waves 



Zhiwu Lin 
Mathematics Department 
University of Missouri 
Columbia, MO 6521 1 USA 



Abstract 

We consider linear instability of solitary waves of several classes of disper- 
sive long wave models. They include generalizations of KDV, BBM, regularized 
Boussinesq equations, with general dispersive operators and nonlinear terms. We 
obtain criteria for the existence of exponentially growing solutions to the linearized 
problem. The novelty is that we dealt with models with nonlocal dispersive terms, 
for which the spectra problem is out of reach by the Evans function technique. 
For the proof, we reduce the linearized problem to study a family of nonlocal op- 
erators, which are closely related to properties of solitary waves. A continuation 
argument with a moving kernel formula are used to find the instability criteria. 
Recently, these techniques have also been extended to study instability of periodic 
waves and to the full water wave problem. 



1 Introduction 

We consider the stability and instability of solitary wave solutions of several classes 
of equations modeling weakly nonlinear, dispersive long waves. More specifically, 
we establish criteria for the linear exponential instability of solitary waves of BBM, 
KDV, and regularized Boussinesq type equations. These equations respectively have 
the forms: 



1. BBM type 



2. KDV type 



d t u + d x u + d x f(u) + d t Mu = Q; (1.1) 



d t u + d x f(u)-d x Mu = 0; (1.2) 
3. Regularized Boussinesq (RBou) type 

d^u-d 2 x u-dlf{u) + d 2 t Mu = Q. (1.3) 

Here, the pseudo-differential operator M. is defined as 

(Mg) (k)=a(k)g(k), 
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where g is the Fourier transformation of g. Throughout this paper, we assume: i) / is 
C 1 with / (0) = /' (0) = 0, and / (u) /u -> oo. ii) a \k\ m < a (k) < b \k\ m for large 
k, where m > 1 and a. b > 0. If / (u) = u 2 and M. = —d 2 , the above equations 
recover the original BBM ([11 ]), KDV ([28 1), and regularized Boussinesq ([51 1) equa- 
tions, which have been used to model the unidirectional propagation of water waves 
of long wavelengths and small amplitude. As explained in [11|, the nonlinear term 
/ (u) is related to nonlinear effects suffered by the waves being modeled, while the 
form of the symbol a is related to dispersive and possibly, dissipative effects. If a (k) 
is a polynomial function of k, then M. is a differential operator and in particular is a 
local operator. On the other hand, in many situations in fluid dynamics and mathemat- 
ical physics, equations of the above type arise in which a (k) is not a polynomial and 
hence the operator M. is nonlocal. Some examples include: Benjamin-Ono equation 
(132)), Smith equation ([47 1) and intermediate long-wave equation ((29)), which are all 
of KDV type with a (k) = \k\ , \/l + k 2 — 1 and k coth (kH) — H^ 1 respectively. 

Below we assume a (k) > 0, since the results and proofs can be easily modified 
for cases of sign-changing symbols (see Section 5(b)). Each of the equations ( 11.11 )- 
( 11.3b admits solitary-wave solutions of the form u (x, t) — u c (x — ct) for c > 1, c > 
0, c 2 > 1 respectively, where u c (x) — > as |a;| — > oo. For example, the KDV solitary 
wave solutions have the form (|28|) 



and for the Benjamin-Ono equation ( lfT2ll ) 



For a broad class of symbols a , the existence of solitary-wave solutions has been 
established (|9[, |10|). For many equations such as the classical KDV and BBM, the 
solitary waves are positive, symmetric and single-humped. But the oscillatory solitary 
waves are not uncommon (Q, J6)), especially for the sign changing a (k). In our 
study, we do not assume any additional property of solitary waves, besides their decay 
at infinity. We consider the linearized equations around solitary waves in the traveling 
frame (x — ct, t) and seek a growing mode solution of the form e xt u (x) with Re A > 
0. Define the operator Cq by J2.2I ), ( 14.41 ), and ( 13.51 ), and the momentum function P (c) 
by ( 12.231 ), d4~8b . and d3~6l ). for BBM, KDV and RBou type equations respectively. 

Theorem 1 For solitary waves u c {x — ct) of equations ( |7.7| )-( TP1 ), we assume 



Denote by n~ (Co) the number (counting multiplicity) of negative eigenvalues of the 
operators Cq. Then there exists a purely growing mode e xt u (x) with A > 0, u € 
H m (R) to the linearized equations ( 12.51 ), ( 14.21 ) and ( li.2l ), if one of the following two 
conditions is true: 

(i) n~ (Cq) is even and dP/dc > 0. 

( ii) n~ (Cq) is odd and dP/ dc < 0. 




ker£ = {u cx } . 



(1.4) 
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Note that the operators Co are obtained from the linearization of equations satis- 
fied by solitary waves, and P (c) = Q (u c ) where Q (u) is the momentum invariant 
due to the translation symmetry of the evolution equations jl . l| )- dT73b .For example, for 
KDV type equitation, Q (u) = | J u 2 dx. The assumption dl.4t can be proved for 
A4 = —d 2 and for some nonlocal dispersive operators (Q, |5])- It has the implication 
that the solitary wave branch u c (x) is unique. More discussions about the spectrum 
assumptions for Co can be found in Section 5(a). 

Let us relate our results to the literature on stability and instability of solitary waves. 
The first rigorous proof of stability of solitary waves is obtained by Benjamin (0), for 
the original KDV equation. Benjamin's idea is to show that stable solitary waves are 
local energy minimizers under the constraint of constant momentum. This idea was 
already anticipated by Boussinesq (| 17 1) and has been extended to get stability results 
for more general settings (J4), El, [22 1, [50 1). In particular, it is shown in ifPfl . Il48l 
that for KDV and BBM type equations, the solitary waves are orbitally stable in the 
energy norm if and only if dP j dc > 0, under the hypothesis 

ker£ = {u cx } , and n~ (£ ) = 1. (1.5) 

For power like nonlinear terms and dispersive operators with symbols a (k) = \k\^, 
the function P (c) can be computed by scaling and thus the more explicit stability 
criteria is obtained (see 03), EH). The stability criterion dP/dc > in fl3), EU 
is by a straight application of the abstract theory of 11221 . and this is also proved in 
11501 . The instability proof of l22l can not apply directly to KDV and BBM cases. In 
03), EH), the proof of 1221 is modified to yield the instability criterion dP/dc < 0, by 
estimating the sublinear growth of the anti-derivative of the solution. A less technical 
way of modification (introduced in [31]) is described in Appendix for general settings. 
Applying Theorem Q] to the KDV and BBM cases with nT (Co) = 1, we recover the 
instability criterion dP/dc < in [14], [48], and furthermore it helps to clarify the 
mechanism of this instability by finding a non-oscillatory and exponentially growing 
solution to the linearized problem. We note that the nonlinear instability proved in 
[ 14], [48 1 is in the energy norm H m > 2 and there is no estimate of the time scale for the 
growth of instability. The linear instability result might be the first step toward proving 
a stronger nonlinear instability result in L 2 norm with the exponential growth. 

When M. — —d 2 , Pego and Weinstein [43] study the spectral problem for solitary 
waves of BBM, KDV and RBou equations by the Evans function technique (IT), lETl ). 
and a purely growing mode is shown to exist if dP/dc < 0. Since for A4 = —d 2 , 
we have ker£o = {u cx } and n~ (Co) — 1 (see Section 5(a)), the result of POl is a 
special case of TheoremQ] The novelty of our result is to allow general dispersive op- 
erators M, particularly the nonlocal operators, for which the spectral problem can not 
be studied via the Evans functions. Comparison with the Evans functions are discussed 
more in Section 5(c). Moreover, our instability criteria for cases when n~ (Co) > 2 
appear to be new, even for the relatively well-studied BBM and KDV type equations. 
The situation nT (Co) > 2 might arise for highly oscillatory solitary waves (i.e. Q, 
[6]). Even for single-humped and positive solitary waves, it is not necessarily true 
that rT (Co) = 1 since there is no Sturm theory for general operators M.. One such 
example is the large solitary waves for the full water wave problem. In 11371 . a simi- 
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lar instability criterion is derived for solitary waves, in terms of an operator Cq with 
a (k) = k coth (kH), for which n~ (Cq) grows without bound as the solitary wave 
approaches the highest wave. 

Let us discuss some implications of our results for solitary wave stability. The 
solitary waves of regularized Boussinesq equations are known ([46], [43 1) to be highly 
indefinite (constrainted) energy saddles, and therefore their stability can not be pursued 
by showing energy minimizers as in the BBM and KDV cases. More interestingly, soli- 
tary waves of the full water wave are also indefinite (constrainted) energy saddles ( |[T5l , 
(27]) and thus the study of stability of RBou solitary waves might shed some light on 
the full water wave problem. We note that energy saddles are not necessarily unstable. 
Indeed, it is shown in [4-5 1 that small solitary waves of the regularized Boussinesq equa- 
tion are spectrally stable, that is, there are no growing modes to the linearized equation. 
So far, we do not know any method to prove nonlinear stability for energy saddle type 
solutions. The spectral stability is naturally the first step. The next theorem might be 
useful in the study of the spectral stability, in particular, for large solitary waves of 
RBou type equations. 

Theorem 2 Consider solitary waves u c (x — ct) of equations rti.il )-( T01 ), and assume 
ker£o = {u cx }. Suppose all possible growing modes are purely growing and the 
spectral stability exchanges at cq, then P' (co) = 0. 

For the original regularized Boussinesq equation, it is shown in 11431 p. 79] that 
P' (c) > for any c 2 > 1. By Theorem [2] and the spectral stability of small solitary 
waves [45], it follows that either all solitary waves are spectrally stable or there is 
oscillatory instability for some solitary waves. So the spectral stability of large solitary 
waves would follow if one could exclude the oscillatory instability, namely, show that 
any growing mode must be purely growing. For BBM and KDV type equations, when 
n~ (Co) > 2, the solitary waves are also of energy saddle type and their stability could 
not studied by the usual energy argument. Above remarks also apply to these cases. 
We note that for KDV and BBM equations, under the hypothesis (11.5b the oscillatory 
instability can be excluded as in the case Ai — —8% dl43l p. 79]), by adapting the 
finite-dimensional argument of BP . 

We briefly discuss the proof of Theorem Q] The growing modes equations J2.41 i, 
d3 ,3b and J4.31 l are non-self-adjoint eigenvalue problems for variable coefficient oper- 
ators and rather few systematic techniques are available to study such problems. Our 
key step is to reformulate the spectral problems in terms of a family of operators A x , 
which has the form of M. plus some nonlocal but bounded terms. The idea is to try 
to relate the eigenvalue problems to the elliptic type problems for solitary waves. The 
existence of a purely growing mode is equivalent to find some A > such that A x has 
a nontrivial kernel. This is achieved by a continuation strategy to exploit the difference 
of the spectra of A x near infinity and zero. First, we show that the essential spectrum 
of A x lies to the right and away from the imaginary axis. For large A, the spectra 
of the operator A x is shown to lie entirely in the right half complex plane. So if for 
small A, the operator A x has an odd number of eigenvalues in the left half plane, then 
the spectrum of A x must get across the origin at some A > where a purely grow- 
ing mode appears. The zero-limit operator A is exactly the operator Cq. Since the 
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convergence of A x to Co is rather weak, the usual perturbation theory does not apply 
and the asymptotic perturbation theory by Vock and Hunziker ([4-9 1) is used to study 
perturbations of the eigenvalues of Co- In particular, it is important to know how the 
zero eigenvalue of Co is perturbed, for which we derive a moving kernel formula. The 
instability criteria and Theorem[2]about the transition points follows from this formula. 
One important technical issue in the proof is to use the decay of solitary waves to obtain 
a priori estimates and gain certain compactness. 

The approach of using nonlocal dispersion operators A x with continuation to find 
instability criteria originates from our previous works ( ||34"ll , J33|, (32]]) on 2D ideal 
fluid and ID electrostatic plasma, which have also been extended to study instability 
of galaxies [24] and 3D electromagnetic plasmas l35ll . 11361 . The consideration of the 
movement of ker.4 is suggested in 11331 Remark 3.2]. The techniques developed in 
this paper have been extended to get stability criteria for periodic dispersive waves 
(ED), and to prove instability of large solitary and periodic waves for the full water 
wave problem (|37|, |38|). This general approach might also be useful for to study 
instability in dispersive wave systems and multi-dimensional problems, which have 
been poorly understood. 

This paper is organized as follows. In Section 2, we give details of the proof of 
Theorem[T]for the BBM case. Section 3 treats the RBou case, whose proof is rather 
similar to the BBM case. The KDV case has some subtle difference to the previous 
cases and is discussed in Section 4. In Section 5, we discuss some extensions and open 
issues. The Appendix gives an alternative way of modifying the nonlinear instability 
proof in ll22l to general dispersive long wave models. 



Consider a traveling solution u (x, t) = u c (x — ct) (c > 1) of the BBM type equation 
d 1 - lb - Then u c satisfies the equation 



We define the following operator Co '■ H m — > L 2 by the linearization of ( 12. U 



2 The BBM type equations 




(2.1) 




(2.2) 



The linearized equation in the traveling frame (a; — ct, t) is 

(d t - cd x ) (u + Mu) + d x (u + f ( Uc ) u) = 0. 
For a growing mode solution e xt u (x) (Re A > 0) of d2.3t . u (x) satisfies 

(A - cd x ) (u + Mu) + d x (u + f (u c ) u) = 0, 



(2.3) 



(2.4) 



which can be written as 



Mu +u + 



A -eft 



(u + f (u c ) u) = 0. 



X 
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This motivates us to define a family of operators A x : H m — > L 2 by 
„4 A U = TWu + u + - — ^— (u + /' (u c ) u) . 

A — CC^ 

Thus the existence of a growing mode is reduced to find A G C with Re A > such 
that the operator A x has a nontrivial kernel. Below, we seek a purely growing mode 
with A > 0. We use a continuation strategy, by exploiting the difference of the spectra 
of the operators A x for A near infinity and zero. We divide the proof into several steps. 



2.1 The properties of A x 

Define the following operators 



V = cSL, £ A <± = 



A 



Then the operator A x (A > 0) can be written as 

A x = M + l--(l-£ x > 



(l + />c)) 



Lemma 2.1 (a) For A > 0, the operators £ A,± are continuous in A and 



?\,±\ 



\l 2 ^l 2 



< 1, 



l-£ 



A,±| 



< 1. 



\L 2 ^L 2 

(b) When A — > 0+, £ A:± converges to strongly in L 2 (R). 
("cj W/?e« A — > +oo. £ A,± converges fo 1 strongly in L? (R). 

Proof. We have 



(2.5) 
(2.6) 



A 



A ± ick 



0(A) 



0(fc) &=||0| 



and ( 12.51 ) follows. Similarly, we get the estimate (12.61 ). By the dominant convergence 
theorem, 



■' A .±, 



A 



.(A;) 



dfc -> 0, 



A ± zc/c 

when A — > 0+. Thus £ A:± — > strongly in L? . The proof of (c) is similar to that of 
(b) and we skip it. I 

Corollary 1 For A > 0, the operator A x converges to Cq strongly in L? when A — > 
0+, and converges to A4 + 1 strongly in L 2 when A — » +oo. 

The following theorem states that the essential spectrum of A x is to the right and 
away from the imaginary axis. 
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Proposition 1 For any A > 0, we have 



(A X ) C { 



z I ReA> \ ( 1- - ) > S> . (2.7) 



2 V c 

The proof of Proposition[T]is based on the following lemmas. 
Lemma 2.2 Consider any sequence 

{u n } G H m (R) , ||u n || 2 = 1, supp u n C {x\ \x\ > n} . 
Then for any complex number z with Re z < 5 (l — ~), we have 

Re ((.4 A - z) u n ,u n ) > ^ (l - i 

vv/zen n is iarge enough. 
Proof. We have 

Re ((A x - z) u n ,u n ) 
= ((M + 1) u n , un) - Re z - Re Q (l - £ A -~) (1 + /' (u c )) ■. 

= ((M + 1) un, u„) - Re z - - Re ((1 + /' (u c )) u„, (l - f A ' + ) u n ) 

> 1 - I ( 1 - -) - - (l + max \f M|) || (1 - £ x > + ) u n \\ 2 

2 \ C J C \ \x\>n / 

>~(l--)-~ max If (u c )| (byLemmaO(a)) 

2 \ c J c \x\>n 

> — ( 1 ) , when n is big enough. 

4 V c 



To study the essential spectrum of A x , first we introduce the Zhislin Spectrum 
Z (A x ) ( 112510 . A Zhislin sequence for A x and z € C is a sequence 

{u n } e H m , ||u„|| 2 = 1, suppu n C {x| |x| > n} 

and || („4 A — z) u n || — > as n — > 00. The set of all z such that a Zhislin sequence 
exists for A x and z is denoted Z (-4 A ) . From the above definition and Lemma [2~2l we 
readily have 

Z(A X ) C jz e C| Rcz > i ^1- iU. (2.8) 

Another related spectrum is the Weyl spectrum (-4 A ) ( 11251 ). A Weyl sequence for 
^4 A and z € C is a sequence {u n } 6 i? m , ||u„|| 2 = 1, u n — * weakly in L 2 
and || (,4 A - z) u n || — > as n — > 00. The set W (J4 A ) is all z e C such that a Weyl 
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sequence exists for A x and z. By ((251 Theorem 10.10]), W (A x ) C cr ess (A x ) and the 
boundary of er ess (*4 A ) is contained in W (A x ) . So it suffices to show that W (A x ) = 
Z (A x ), which together with (ED implies (f277b . By ((25] Theorem 10.12]), the proof 
of W (A x ) = Z (A x ) is reduced to prove the following lemma. 

Lemma 2.3 Given A > 0. Let \ G (R) be a cut-off function such that x\{\x\<r«} 
I /or .some i?o > 0. Define Xd = X (%/d) , d > 0. Then for each d, \d (A x — z) 
is compact for some z £ p (A x ), and that there exists C (d) — > as d — > oo smc/i f/zaf 
/or any u e (R), 

|| [^ A ,Xrf] u|| 2 <C(d) (\\A x u\\ 2 + \\u\\ 2 ) . (2.9) 
Proof. We write A x = M + 1+K, x , where 

IC X = - c (1 - £ A ^) (1 + /' K)) :L 2 ^L 2 (2.10) 

is bounded. So — fc 6 p (-4 A ) when k > is sufficiently large. The compactness of 

Xd (-4 A + fc) 1 is a corollary of the local compactness of H m ^ L 2 . To show ( |2.9t , 
we note that the graph norm of A x is equivalent to 1 1 • 1 1 H m . Below, we use C to denote 
a generic constant. First, we have 

[K\ Xd] =-\ [S x -,Xd] (1 + /' (uc)) = P, Xd] (1 + /' (ttc)) 

and thus 

m\xd]\\ L ^ L2 <^. (2.H) 

Let / = [m] to be the largest integer no greater than m and S — m — [m] £ [0, 1). 
Define the following two operators 

-M 1= { i+ {f); if ^ 2 ™ d4 (2 . 12) 

| 1 _ (jL) 1 if; = 2 mod 4. 
and AI2 is the Fourier multiplier operator with the symbol 



T if/^2mod4 
if I = 2 mod 4. 



n(k) = \ „ ■ (2-13) 



ThenX = M 2 Mi and 

[M,Xd] = M 2 [Mi,Xd] + [M 2 , Xd] Mi 
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We study [Ai 2 , Xd] in two cases. When 6 = 0, that is, m is an integer, for any v £ 
C£° (R), we follow El P.127-128] to write 



[M 2 , Xd] v = - (2?r) 2 / h(x-y) (xd (x) - Xd (y)) v (y) dy 

(2tt)~ 2 (x-y)n(x- y) \' d (p (a: - y) + y) v (y) dydp 



1 

A p w dp, 

where A p is the integral operator with the kernel function 

K p (x, y) = - (27r) -5 (x-y)h(x- y) X ' d (p (x - y) + y) . 

Note that (3 (x) — xn (x) is the inverse Fourier transformation of in' (k) and n! (k) £ 
L 2 when I = m, so (3 (x) £ L 2 . Thus 

\K p (x,y)f dxdy = 2tt / / |/3| 2 (x - y) |x d | 2 (p (x ~ y) + y) dxdy 

= 2tt J J |/3| 2 (x) \ X ' d \ 2 (y) dxdy = 2tt \\(3\\l 2 \\ X ' d \\% 

2lT nan 2 11 '11 2 
= -j \\p\\l 2 \\X Hl 2 • 

So 

\\[M 2 ,Xd}\\ L 2^ L 2 < 

d2 

and 

II [M 2 , X d]M 1 u\\ L2 < *L \\M lU \\ L2 < \\u\\ Hm . 

When S > 0, we define two Fourier multiplier operators A4 3 and M4 with symbols 
1 + \k\ S and n x (k) = n(k) / (l + \k\ 5 j respectively. Then M 2 = M3M4 and 

[M 2 , Xd] = M A [M 3 , Xd] + [M 4 , Xd] M 3 - 
Since n' x (k) £ L 2 , by the same argument as above, we have 

C 

\\[MA,Xd]\\ L 2^ L 2 < -T- 

d2 

By E21 P. 213, Theorem 3.3], 

\\[M 3 ,Xd]\\ L 2^ L 2<C(6)\\\D\ s Xd 

where \D\ S is the fractional differentiation operator with the symbol |fc| 5 and ||-||^ is 
the BMO norm. By using Fourier transformations, it is easy to check that 
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So 



and therefore 



\D\ 6 X d <2 \D\ 6 X d 



\D\ 5 X 



\\[M 3 , X d}\\ 



L 2 ^L 2 



< 



c_ 



Since ||-M4|| i2 ^£2 is bounded, we have 



\\[M 2 ,Xd]Miu\\ L2 < \\M i [M 3 ,Xd]M 1 u\\ L2 + \\[M il Xd]M 3 Miu\\ L2 
< § \\Miu\\ L2 + -| WMsMmWv <c(j s +^ 

So in both cases, 

||[M 2 , Xd]Miu\\ L2 < C (d) \\u\\ Hm , with C (d) -> as d -► oo. 

Since 



(2.14) 



lMi,Xd] - ^ C 3 — or , ^ . ^_ . , 

3=1 3=1 



and 



we have 



dxi 



(X) d? x0) (d) : " di X ^' 



\\M*\MuXd\u\\^<Y^{^M^ X f 

3 = 1 

By similar estimates as above, when 6 = 0, 

< £L 

L 2 d 2 



L' 1 



llxll 



{1-3) 



L 2 



M 2 ,x i J ) 



< — N 



H" 



and when <5 > 0, 



c_ 

l 2 ~ ~~d^ 



C_ 

L 2 d^ 



M3U 



(1-3) 



L 2 ^^ + ^^"^ 



Thus 

\\M 2 [Mx,Xd] u\\ 2 < IMIjym » withC(d) -> as d -> 00. 

Combining above with d2.1 U and ( 12.141 ). we get the estimate \2.9\ . This finishes the 
proof of the lemma and PropositionQ] I 

To show the existence of growing modes, we need to find some A > such that A x 
has a nontrivial kernel. We use a continuation strategy, by comparing the behavior of 
A x near and infinity. First, we study the case near infinity. 

Lemma 2.4 There exists A > 0, such that when A > A, A x has no eigenvalues in 
{z\ Rez < 0}. 
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Proof. Suppose otherwise, then there exists a sequence {A„} — * oo, and {k n } 6 
C, {u n } € H m (R), such that Re k„ < and (_4 A " - k n ) u n = 0. Since ||.4 A - M-l\ 

||/C A || < M for some constant M independent of A and M is a self-adjoint positive 
operator, all discrete eigenvalues of A x lie in 

D M = {z\ Rez> —M and \Imz\ < M} . 

Therefore, k n — > k^ 6 Dm with Refcoo < 0. Denote e (x) = (/' (u c )) 2 , then 
e (x) — > when |x| — > oo. We normalize «„ by setting ||u n ||i2 = 1. where 

IHIli= (/e(x)|n| 2 . (2.15) 

We claim that 

|| u ri|| H ^- < C, for a constant C independent of n. (2.16) 

Assuming ( 12.161 ), we have u n — > Uoo weakly in i? m . Moreover, Uoo ^ 0. To show 
that, we choose R > large enough such that maxu^a e (#) < Then 

f 2 1 1 

/ e{x)\u n \ dx < — \\u n \\ L i < -. 

J\x\>R ZL > Z 

Since u n — > strongly in L 2 ({|ai| < i?}), we have 

[ r i // I ~ <1 r ' 



e (x) |woo| Z dx = lim / e (a;) |u„| 2 da; > — 



\x\<R n ^°°J\x\<R 

and thus ^ 0. By Corollary Q] _4 A " — > .M + 1 strongly in L 2 , therefore A x "u n — ► 
(.M + 1) Uoo weakly and (Ai + 1) — k^u^. Since Re fcoo < 0, this a contradic- 
tion. It remains to show ( 12.16b . From (A Xn — fc„) u n = 0, we get 

> Refc„ ||u„|| 2 = {{M +l)u n ,u n )- ^Re (u n , (1 - £ x >+) u n ) 

- ^Re(/' K) w „,(l-£ A <+) Wn ) . 

By our assumption on the symbol a (k) of M., there exists A" > such that a (k) > 
a \k\ m when |A:| > K. So for any e, S > 0, from above and Lemma [2~T1 we have 

> (1 - <5) ||u„|| 2 2 + a / |fc| m |it (/c)| 2 dk + S [ \u (fc)| 2 dfc 



|fc|>if J\k\<K 



1„ „2 1 



- II«t.||£* - - ||M„|| L 2 ||M„|| L 2 



|u {k)\ 2 dk- - \\u n \\ 2 T 2 
c 



> (l-,5)|| u „|| 2 2+m m j-^aj J 

II II 2 e II II 2 

> mini 1 - i - S- e, ^,4 IKH^ - ^2 IMIlJ 



The bound ( 12.161 ) follows by choosing <5, e > small. 
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2.2 Asymptotic perturbations near A = 

In this subsection, we study the spectra of A x for small A. When A — * 0+, A x — > Co 
strongly in L 2 , where Co is defined by ( 12.21 ). Since the convergence of A x — > Co 
is rather weak, we could not use the regular perturbation theory. Instead, we use the 
asymptotic perturbation theory developed by Vock and Hunziker ([49]), see also 11251 , 
|. To apply this theory, we need some preliminary lemmas. 

0+ and {u n } £ 
(2.17) 



Lemma 2.5 Given F 6 (R). Consider any sequence X Tl 
H m (R) satisfying 

||-4 A "u„|| 2 + \\u n \\ 2 < Mi < oo 
for some constant Mi. Then if w — lim rl ^oo u n = 0, we have 



lim \\Fur. 







(2.18) 



and 



lim ||[„4>,F] 



0. 



(2.19) 



Proof. Since ( 12.171 ) implies that 



iff" 



< G, ( 12.181 1 follows from the local 



compactness of H m =— > L 2 . To prove (12.191 l, we use the notations in the proof of 
Lemma|23] We write A Xn = M + l+/C Xn . Note that 

[M,F] = [M 2 Mi,F] = M 2 [Mi,F] + [M 2 , F]Mi, 

where Mi and M 2 are defined in (12.121 i and (12.13b . Let G G Gq° (R) satisfying 
G = 1 on the support of i* 1 . For any e > 0, we have 



[Ml, -Flu* 



y> , d'F #-i (Gu n ) 



3 = 1 



< C \\unWjji--L < e \\u n \\ Hm + C e \\Gu n \\, 



Since e is arbitrarily small and the second term tends to zero by the local compactness, 



it follows that ||[.Mi,F] ' 



when n — ► oo. Since n' (k) — > when \k\ 



oo, by [19, Theorem C] the commutator [.Mzj-F] : L 2 — > L 2 is compact. Since 
UnWjjm 5~ G and u n — > weakly in L 2 , we have A^iu n — * weakly 

in L 2 . So 



\[M 2 ,F}Miu r , 







strongly in L 2 and thus || [Ad, F] u r , 



0. Since 



1 



[JC X - ,F]u n = -- [£ X "'~,F] (1 + /' (u c )) u„ 

= -If A„,- F (1 + ^ (Mc)) Un + An," (1 + /' ( Uc )) Un 



Denote v n = (1 + /' (u c )) u n . From the uniform bound of ||wn||jj-m, we get the uni- 
form bound for \\v n \\ Rm . Therefore, by local compactness, 



Ibn|| 2 < C Il^ w n|l2 ~* °> when n 
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Since the operator ||£ A ' || L2 ^ L 2 < 1 ar >d & X ' is commutable with (l — -f^j , for 
any A > 0, we have the estimate 

||^'-L m ^ m <i. 

So denoting v n = £ Xn '~v n ,we have the uniform bound for ||i)n||# m and thus 

||Pn|l2 < C ll-f ^nllg — * 0, when n — > oo. 
This finishes the proof of ( 12. 19b . I 

Lemma 2.6 Let z G C with Rez < ^ (l — ij, then for some n > area? a// it G 
Co° (M — n )> we have 

1 ( 1 



(^ A -z) U || 2 > i (l--)|| M || 2 , (2.20) 



w/zen A is sufficiently small. 

Proof. The estimate ( 12.201 follows from 



Re ((.4 A - z) u, u) > i (l - - J ||«||a , (2.21) 



which can be obtained as in the proof of Lemma |2T2| I 

With above two lemmas, we can apply the asymptotic perturbation theory ([25 1, 
ll49l ) to get the eigenvalue perturbations of A to A x with small A. 

Proposition 2 Each discrete eigenvalue ko of A with ko < | (l — ) is stable with 
respect to the family A x in the following sense: there exists Ai, 8 > 0, such that for 
< X < Xi, we have 
(i) 

B (k ; 6) = {z\ < \z - fc | <5}cP (A x ) , 

where 

P (-4 A ) = lz\ R X (z) = (_4 A — z) exists and is uniformly bounded for X G (0, X\)\ 
( ii) Denote 

& R x (z) dz and P Q = <L R Q (z) dz 

J{\z-k \=S} J{\z-k \=5} 



to be the perturbed and unperturbed spectral projection. Then dim P\ = dim Pq and 
limx^oHPA-Poll =0. 

It follows from above that for A small, the operators A x have discrete eigenvalues 
inside B (ko;6) with the total algebraic multiplicity equal to that of ko. 
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2.3 The Moving kernel formula and proof of instability 



To understand the entire spectrum of A x for small A, we need to know precisely how 
the zero eigenvalue of A = C° is perturbed. For that, we derive a moving kernel 
formula, from which the instability criterion follows. Let Ai , <5 > be as in Proposition 
|2] for fco = 0. By our assumption that ker.4 = {u cx }, so dimPo = 1 an d thus 
dim Pa = 1 f° r A < Ai. Since the eigenvalues of A x appear in conjugate pairs, there 
is only one real eigenvalue k\ of A x inside B (0; 8). The following lemma determines 
the sign of k\ , when A is sufficiently small. 

Lemma 2.7 Assume ker£° = {u cx }. For A > small enough, let k\ G R to be the 
only eigenvalue of ' A x near origin. Then 

^ im , = ~~~r/ IK^Hi 2 , (2.22) 
a^o+ A z c ac 

where the momentum 

P(c) = ^({M+l)u c ,u c ) (2.23) 

By the same proof of ( 12.16b . we get the following a priori estimate which is used in 
the later proof. 

Lemma 2.8 For A > small enough, consider u £ H m (R) satisfying the equation 
(A x — z)u = v, where zeC with Re z < h (l — -) and v G L 2 . Then we have the 
estimate 

\\u\\ h9 <c(\\u\\ Ll + \\v\\ L2 ), (2.24) 
for some constant C independent of X. Here, the weighted norm \\-\\ L 2 is defined in 

Assuming Lemma |2~71 we prove Theorem[T]for BBM type equations. 

Proof of Theorem l4.3l (BBM). We prove (ii) and the proof of (i) is similar. Assume 
that nT (Co) is odd and dP/dc < 0. Let fc-f , • • • , fc ; ~ be all the distinct negative 
eigenvalues of Co- Choose S > small such that the I disks B [k^; dj are disjoint 
and still lie in the left half plane. By Proposition |2j there exists Ai > and S small 
enough, such that for < A < Ai, A x has n~ (Cq) eigenvalues (counting multiplicity) 
in \j\_ x B (k~; 5) . By Lemma 12771 if dP/dc < 0, then the zero eigenvalue of A is 
perturbed to a positive eigenvalue < k\ < S of A x for small A. Consider the region 

Q = {z | > Rez > -2M and \lmz\ < 2M} , 

where M is the uniform bound for ||/C A || = ||„4 A — M.— 1 . We claim that: for A 
small enough, A x has exactly n~ (Co) + 1 eigenvalues (with multiplicity) in 

n s = {z | 26 > Rez > -2Mand \Imz\ < 2M} . 
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That is, all eigenvalues of A x with real parts no greater than 25 lie in U| =1 B (k i ; S) U 
B (0; S). Suppose otherwise, there exists a sequence A„ — > and 

{«„} e tf m (R) , z„e!!/ (utiS (fef; 5) u B (0; 6)) 

such that (^4 Ati — z n ) u n = 0. We normalize u n by setting ||u„|| i2 = 1. Then by 
Lemma [2781 we have < C. By the same argument as in the proof of Lemma 

12.41 u n — > 7^ weakly in . Let 

lim zn = ZQC efl/ (U =1 B fa; 8) UB(0;i)) 

n— >oo 

then £ Uoo = z^iioo, which is a contradiction. The claim is proved and thus for A 
small enough, A x has exactly n~ (Co) eigenvalues in fi. 

Suppose Theorem l4.3l (i) is not true, then A x has no kernel for any A > 0. Define 
nn (A) to be the number of eigenvalues (with multiplicity) of A x in f2. Since by |2.7l the 
region £1 is away from the essential spectrum of A x , nn (A) is always a finite integer. 
In the above, we have proved that nn (A) = n~ (£ ) is °dd, for A small enough. By 
Lemma |2~4l there exists A > such that nn (A) = for A > A. Define two sets 

Sodd = {A > 0| nn (A) is odd} , S even = {A > 0| nn (A) is even} . 

Then both sets are non-empty. Below, we show that both 5 dd and Seven are open sets. 
LetAo € S'odd and denote k\ , ■ ■ ■ <nn (Ao)) to be all distinct eigenvalues of A x " 

in fL Denote ihi, ■ ■ ■ , ih p to be all eigenvalues of A on the imaginary axis. Then 
\hj\ < M, 1 < j < p. Choose 5 > sufficiently small such that the disks B (hi; S) 
(1 < i < I) and B (ihf, S) (1 < j < p) are disjoint, B (k%\ 5) C Vt and B (ihj] 5) does 
not contain 0. Note that A x is analytic in A for A £ (0, +oo). By the analytic perturba- 
tion theory ([25]), if |A — Aq| is sufficiently small, any eigenvalue of A x in fls lies in 
one of the disks B (kf, S) or B (ihj] 5). So nn (A) is the number nn (Ao) plus the num- 
ber of eigenvalues in {J?_-,B (ihj; 5) with the negative real part. The second number is 
even, since the complex eigenvalues of A x appears in conjugate pairs. Thus, nn (A) is 
odd for |A — Ao| small enough. This shows that 5 dd is open. Similarly, 5 even is open. 
Thus, (0, +oo) is the union of two non-empty, disjoint open sets 5 dd and S^ven- This 
is a contradiction. 

So there exists A > and ^ u e H m (R) such that A x u = 0. Then e xt u (x) is 
purely growing mode solution to ( 12.3b . One could also get more regularity of u (x), as 
in the usual proof of the regularity of solitary waves (i.e. IfTUl ). I 

It remains to prove the moving kernel formula ( 12.22b . 

Proof of Lemma[2~7l We use C to denote a generic constant in our estimates below. 
As described at the beginning of this subsection, for A > small enough, there exists 
u\ S H m (R), such that (_4 A - k\) u\ — with fc A € R and lim A ^o+ k\ = 0. We 
normalize u\ by setting ||wa|Il2 = !• Then by Lemma l2~8~l we have ||ua||d-^ < C and 
as in the proof of Lemma l2.4l u\ — > uo weakly in . Since A°uq = Cquq = 
and ker£o = {u cx }, we have uo = cqu cx for some cq ^ 0. Moreover, we have 
II^a — mo|| h ^. = 0. To show that, first we note that \u\ — uqIIls — > 0, since 
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and the second term is arbitrarily small for large R while the first term tends to zero by 
the local compactness. Since 

(A x - k\) (u x - u ) = k x u + (A - A x ) u , 
by Lemma 12751 we have 

\\u x - u \\ H ™ < C (\\ux - u f L 2 + \k x \ \\u a \\ 2 L2 + || (A° - A x ) u ||* 2 ) -> 0, 

when A — * 0+. We can assume Co = 1 by renormalizing the sequence. 

Next, we show that liniA^o+ x = ®- F rom (-4 A — kx) u\ = 0, we have 

k x u x A x -A° 

—u x = A u — J \ ux- (2.25) 

Taking the inner product of above with u cx , we get 
kx , , fA x -A° 



We have 



^ {ux, u cx ) = I ux, u cx ) := m (A) . 



m (A) = {l ^_ v (1 + /' (u c )) ux,u cx ^j = i ^(1 + /' (u c )) u x , x ^ v u c-- 

= 1 ((1 + /' (u c )) UX, (1 - 5 A ' + ) U C ) -> i ((1 + /' (U C )) U cx , U C ) 

where F (u) = J" /' (s) sds and in the above lirriA->o+ £ A ' + = is used. So 

Um % = lim = o. 

A^0+ A A^0+ [ux,u cx ) 

We write u x = cxu cx + Xv x , where c x = (lt\, u cx ) / {u cx ,u cx ). Then (vx, u cx ) = 
and c A — > 1 when A — > 0+. We claim that: H^aIIj^ < C (independent of A). Suppose 
otherwise, there exists a sequence A„ — > 0+ such that ||wA n ||r2 > n. Denote iij n = 
u a„/ ||i>a„ 1 1 £2- Then ||u\ B ||.E,a = 1 and vx n satisfies the equation 

1 fkx n A x - - A \ 

A n V Xn = 7TZ n "l - U A„ - C A „ : Ucx ■ (2.26) 

\\ v xJ\li V A « A « / 

Denote 

A x - A" 
wx (x) = u cx , 



then 



= -t^h + l)u c = - (f A '- - 1) (M + IK, 

C A ' — Ls C 
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where we use the equation 

C Q u cx = Mu cx + I 1 - - ) Ucx - -/' (u c ) u cx = 0. 



By Lemma lZTl ||uia|| £ 2 < C (independent of A), and 

w x (x) -> -- {M + 1) u c = i (u c + / K)) (2.27) 

c cr 

strongly in L 2 , when A — > 0+. So by Lemma l2~8l we have ||«a„ || „^ < C. Then, as 

before, «a„ — > vo ^ weakly in , Since -y 21 -, - — > 0, we have -4°w = 0. 

So -Do = ciu ca: for some ci 7^ 0. But since (5a„,Kci) = 0, we have (vq,u cx ) = 0, a 
contradiction. This establishes the uniform bound for ||wa|Iz,2. The equation satisfied 
by v x is 

, x k x A x - A k x 

A V\ = —MA - Ca r U cx = — U X - C X W X . 

An A An. 



Applying Lemma l278l to the above equation, we have ||ua||jj-^ < C and thus v x — ► vq 
weakly in Ht. By (12.271 1. vq satisfies 



„4°v = C v Q = -(M + l)u c . 
c 



Taking d c of ( 12.11 ). we have 



C d c u c = -- (M + 1) u c . (2.28) 

c 



Thus £ (vq + d c u c ) = 0. Since (« , u C3; ) = lirru_»o+ (vAi^cx) = 0, we have 

«o = -9 c u c + d u cx , d = (d c u c , u cx ) / \\u cx \\ 2 L2 . 
Similar to the proof of \\u\ — u Q \\ H ™ — > 0, we have ||va — w o|| — > 0. We rewrite 

u\ = c x u cx + Ada = c x u cx + Xv Xl 

where c x — c x + Xd , v x — v x — d u cx . Then c x —*l,v\—> —d c u c ,when A — > 0+. 
Now we compute liniA^o+ j?- From ( I2.25l l. we have 

a0 u x A x -A° fc x \ k x 

Taking the inner product of above with u cx , we have 

fcx, - f A x -A° \ f A x -A° _ \ 

J2 K u \i u cx) = CA I "j^ U C2; , U ca; I + I ^ W A, U ca; I = CA^l + V2- 
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For the first term, we have 

'A x -A° 



h 



A 2 

-(— 
c\X-V 



'^CX 1 



w\ (x) 



V 



c \(X-V) X 



(M + l)u c ,u c 



{M + l)u c ,u c 



cX 



{{M + 1) ^Ci ^CX ) 



{(£ X ' - l) (M + 1) u c , u c ) - (u c + f K) , u cx ) 



1 



c 2 A 
1 



= — ^ ((£ A '~ - 1) (M + 1) u c , u c ) -> — ({M + 1) u c , u c ) , when A + 



For the second term, we have 



A 

1 / P 



v\,u cx 



1 / 1 



c VA-P 



(1 + /' (u c ))v\,u c 



(1 + /' («c)) «A, «c) = ((f A '" - 1) (1 + /' («c)) «A, «c) 



-9 ((! + /' ( u c)) <9 c u c , u c ) , when A -> 0. 



Thus 



,. k\ c\h + h 
lim -rr = lim -. 

A^0+ A 2 A^0+ (U\,U CX ) 

1 



((M + 1) U C , U C ) - -o ((1 + /' (U C )) OcUc, U C ) 



CX\\ L 2 



-- ({M + l)d c u c ,u c ) = — , 

c c dc 



since by (I2T28I 



(M + 1) u c - (1 + /' (u c )) c> c w c = -c (M + 1) d c u c 



3 Regularized Boussinesq type 

Consider a solitary wave u (x,t) = u c (x — ct) (c 2 > l) of the regularized Boussinesq 
(RBou) type equation ( 1 1 . 3b - Then u c satisfies the equation 

Mu c +U-^Juc-^/(uc)=0. (3.1) 

The linearized equation in the traveling frame [x — ct, t) is 

(d t - cd x f (u + Mu) -0 2 x (u + f (u c ) u) = 0. (3.2) 
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For a growing mode e xt u (x) (Re A > 0), u (x) satisfies 

(A - cd x f (u + Mu) - flg (u + /' (w c ) u) = 0. (3.3) 
So we define the following dispersion operator A x : H m — » L 2 (A > 0) 

„4 A u = Mm + u - ( - ^ \ (u + f (u c ) u) 
\X-cd x J 

and the existence of a purely growing mode is reduced to find A > such that A x has 
a nontrivial kernel. Since when A — > 0+, 

d x T> 1 , x , 1 , 

^ = _ = - - 1) ^ -- strongly m L , (3.4) 

the zero limit of the operator.4 A is 

C :=M+ (l-^) ~^/'(«c). (3-5) 

The proof of Theorem[T]for RBou case is very similar to the BBM case, so we only 
give a sketch of the proof of the moving kernel formula. 

Lemma 3.1 Assume ker£° = {u cx }. For A > small enough, let k\ G R to be the 
only eigenvalue of A x near zero. Then we have 



k x 1 dP 2 
hm — = - — — \\ Ucx \\ L 2 , 
a^o+ A 2 c 2 dc 



where 

P(c)=c((M+l)u c ,u c ). (3.6) 
Proof. For A > small enough, let 

u x e H m (R) , k x e R. lim fc A = 0, 

A^0+ 

such that (_4 A — kx) ux = 0. We normalize ux by setting ||ua|| £ 2 = 1. Then as in the 

BBM case, we have ||«a|| h ^ < C and ux — * u C a; in by a renormalization, under 
our assumption that ker£o = {u cx }. 

First, we show that liniA^o+ ^ = 0. As in the BBM case, we have 



kx . , fA x -A° 



A 

where 



-r- ("a, u cx ) = ( — — u Xl u cx I := m (A) . 



A x -A" 1 / 2 A \ 
A ^ ^ I (X^)^ J 
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We have 



m (A) 



x-v (x-vy 



1 [(! + /' (« C ))« A / 2 



(1 + /' (?i c ))?i A ,?i c 
A \ 



1 / 12V 

- (1 + /'(U C ))« A) " 



A + P (A + C)^ 
A£> 



and thus 



a + p (a + p) 2 ; 

1 ((1 + /' K)) UA) (1 - f A '+) (2 - Uc ) 



-o ((1 + /' (u c ))u c;E ,u c ) = 0, 



A^O+ A A^O+ (u Xl u cx ) 

Similarly to the BBM case, we can show that u\ = c\u cx + Xv\, with c\ — » 1, 
u A — » —d c u c in i7 t , when A — > 0+. In the proof, we use the facts that 



w\ (x) = 



A x -A ° 
A 

/ 2 A 
I A-X> ~ (A - 



1 



A 



X — V 



(\-vy 



(! + /' (« c ))« c 



(X + 1) u cx 



I / 2V 



XV 



c\x-v (x-vy 



(M + l)u c 



(M + 1) u c , when A -> + . 



and 



2 2 
£ d c u c = — ^ (u c + / (u c )) = — (M + 1) u c 



(3.7) 



Next, we compute lim A ^ + by using 



A 2 



(ti A ,U cx ) = C A 



A 2 



^ A - A . 
X 



V\,U CX = C\h + I 2 - 
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For the first term, we have 

, :a x - a° 

h 



since E 



A.— 



A 2 



/ W\ (x ) 



-,u c 



223 



V 



(X-V)X (A - Vf 
223 2 23 2 



(A -23) A (A -23)' 



(M + l) 



(X + l)tt c ,«c 



1 



- - 1) [M + 1) uc, Uc) + ^ (23 (7W + 1) u C) u c ) 



+ 



^((£ X '- -l) 2 (M + l)u c ,u c ) 



3 

— ((7W + 1) u c , u c ) , when A — > 0+, 

c 2 

Oand 



(23 (7W + 1) u c , u c ) = c (uc,., (A-f + 1) u c ) = - (u cx , u c + f (u c )) = 0. 

c 



For the second term, we have 



h = 



A x -A° 



223 



1 

~ 2 
A23 



A 



A -23 (A-23) 2 



A -23 (\-V) 2 
(1 + /' (u c )) v x ,u c 



(1 + /' (u c ))v\,u c 



((£ A - - 1) (2 - £ A '-) (1 + /' (u c )) v x ,u c ) 

2 

— o ((1 + /' K)) 3 c tic, u c ) , when A -> + . 



Thus 



lim — ^ = lim 



ca2i + 2 2 



A^0+ A 2 A^0+ (u x ,u cx ) 

3 2 

— ((7W + 1) u c , u c ) - — ((1 + /' (u c )) d c Uc, u c ) 



1 2 
— ? ((7W + 1) u c , u c ) - - {{M + 1) d c u c , u c ) 
cr c 

IdP a 
-^/IK-IIl". 



/ll« 



/ ||Uca;|| i 2 
2 



cx\\ L 2 



(1 + /' (« c )) d c u c = c 2 {M + 1) d c u c + 2c{M + 1) u c . 
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As a corollary of the above proof, we show Theorem [2] for the RBou case. We 
skip the proof of Theorem|2]for the BBM and KDV cases, since they are very similar. 
Theorem[2](RBou) follows from the next lemma. 

Lemma 3.2 Assume ker Cq = {u cx }. If there is a sequence of purely growing modes 
e nt u n (x) (A„ > 0) for solitary waves u 0n of M-3\) , with A„ — * 0+, c n — > cq, then we 
must have P' (co) = 0. 



Proof. The proof is almost the same as that of Lemma [37T1 so we only sketch it. 
The only difference is that now the computations depend on the parameter c n . Denote 
£n = a ±c d ' t ^ len ^ v ^ e same argument as in the proof of Lemma |2~T1 we have 
s — lim JWOO = 0. Then the operator 

A ^o n =M + l _ ( & \ \ l + f {UcJ) 

\ A n — C n O x J 

converges to 

Co ~M + (l-±)-±f(u C0 ) 



\ u / °0 

strongly in L 2 . We have A Xn ' Cn u n = and we normalize u n by ||un|| L 2 = 1, where 

e n = |/' ( u c„)| 2 - As before, it can be shown that ||u„|| ff ™ < C (independent of n) 
and u n — > u CoX in . Moreover, we have u n = c n u CnX + \ n v n , where c„ — > 1 and 
v n — > — 9 c w c |c m -ff^"- From A Xn ,c " u„ = 0, it follows that 



\ A n J \ An 

where 

By the same computations as in the proof of Lemma lXTl 



I 



2 1 / \ 

((£- -i)(M + l)u Cn ,u Cn ) + ({£- - if (M + l)u Cn ,u Cn j 



and 



Thus 



3 

-((M + l) u C() , u CQ ) , when n — > oo 



2 

— o ((1 + / (u Co ))5 c it c | Co ,u Co ) , when n -> oo. 
c o 



= lim (c n h + h) = -3 — (co) 



1 rfP 

Cq g?c 

and the Lemma is proved. I 
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4 KDV type 



Consider a solitary wave u (x, t) — u c (x — ct) (c > 0) of the KDV type equations 
( 11.21 i. Then u c satisfies the equation 

Mu c + cu c - f (u c ) = 0. (4.1) 

The linearized equation is 

(d t - cd x ) u + d x (/' (u c ) u - Mu) = 0. (4.2) 
and for a growing mode solution e xt u (x) (Re A > 0), u (x) satisfies 

{\-cd x )u + d x (f'(u c )u-Mu) = 0. (4.3) 
We define the following dispersion operator A x : H m — * L 2 (Re A > 0) 

A x u = cu+ — — (/' ftt c ) u - Mu) 
A — co x 

and as before the existence of a purely growing mode is reduced to find A > such that 
A x has a nontrivial kernel. When A — > 0+, A x converges to the zero-limit operator 

C := M + c - f ( Uc ) . (4.4) 

The proof of TheoremQ]for KDV is similar to the BBM and RBou cases. So we 
only indicate some differences due to the different structure of the operator A x . To 
prove the essential spectrum bound 

o^ss (A x ) C |z |ReA > ^cj , (4.5) 



we need to establish analogues of Lemmas 12.21 and 12.31 First, we note that, for any 

u G H m (R) , 



Re (- - ° d \ Mu, u) =Re [ —^L a (k) 0(jfe) 
\ A — co x J J A — ick 



(cfc) 2 a(k) 4>(k) 



A 2 + (cky 

So by estimates as in the proof of Lemma l2~2l for any sequence 

{«„} G H m (R) , ||u n || 2 = 1> suppu n C {x\ \x\ > n} , 
and any complex number z with Re z < he, we have 

Re ((^l A - z) u n ,u n ) > -c, 
when n is large enough. Since 

[A x , X d] = {1-£ X -) lM, X d} + [E x -,Xd] (f(u c )-M). 



dk (4.6) 

» 

' dk > 0. 



the conclusion of Lemma 12.31 still holds true by the same proof. Thus the essential 
spectrum bound ( 14.5b is obtained as before. The non-existence of growing modes for 
large A is proved in the following lemma. 
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Lemma 4.1 There exists A > 0, such that when A > A, A x has no eigenvalues in 
{z\ Rez < 0}. 

Proof. Suppose otherwise, then there exists a sequence {A„} — > +oo, {k n } E 
C, and {u n } E H m (R), such that Refc n < and (A Xn - k n ) u n = 0. Let K > 
be such that a (fc) > a \k\ m when \k\ > K. For any 8, e > 0, and large n, we have 
8X n > K and 



> Re(A x "u n ,u n ) 



- I ^T~~P~k \un (k)\ 2 dk + c\\u n \\ 2 L 2 - max \f (u c )\ \\u n \\ 



(cfc) 2 


ce(fc) 


A 2 + 


(cfc) 2 


(cfc) 2 


a (fc) 


A 2 + 


(cfc) 2 


(cfc) 2 


a(fc) 



cd x 



\ n + CC^; 



L 2 



> / rr. K(fc)i 2 ^+( C -e)ii M »n 2 L2 - max| £ K)|2 y A2 ( f } c 2 fc)2 kwi 2 ^ 

, „,,2 „ , ... ,,2 max I f (u c )| 2 /" (cfc) 2 a (fc) . „ . ,o „ 

> / 2 . ,2 "n fc ^ + (c-g K i» - , sm / x2 T ^ \Un{k)\ 2 dk 

A 2 + (cfc) 4ea (5X n ) J\ k \>s\ n X 2 n + (cfc) 

max |/' (u c )| 2 c 2 <5 2 r 

max|/'(u c )| 2 \ [(ckfa(k) m ,2,, . / max |/' (u c )| 2 c 2 <5 2 

- 4ea(SX n ) m J A 2 + (cfc) 2 4^ 



|u„(fc)| dfc 

fc|<(5A„ 



2 



> 0, when n is large enough, 

by choosing e,8 > such that 

c _ £ _ max I/' (u c )|c 2 (5 2 Q 
4e 

This is a contradiction and the lemma is proved. I 

The eigenvalues of A x for small A are also studied by the asymptotic perturbation 
theory. The required analogues of Lemmas 12.31 and l2~6l can be proved in the same way. 
The discrete eigenvalues of .4° = £0 are perturbed to get the eigenvalues of A x for 
small A, in the sense of Proposition |2] The instability criterion in Theorem Q] can be 
proved in the same way, by deriving the following moving kernel formula: for A > 
small enough, let k\ E R to be the only eigenvalue of A x near zero, then 

A 1 i m + A^ = "^ /I1 ^ 11 ' 2 ' (4 - ?) 

where 

P(c) = ±(u c ,u c ). (4.8) 



We sketch the proof of ( 14.71 ) below. First, similar to Lemma l278l we have the following 
a priori estimate: 

For A > small enough, if (A x — z) u — v, z E C with Re z < ^c and v E L 2 , 
then 

HI** <C[\\u\\ Li + \\v\\ L2 ), (4.9) 
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for a constant C independent of A. To prove ( 14. 9i , we note that for any e > 

Re(A\,u) - ~c\\u\\l 2 < \\u\\ L2 \\v\\ L2 <e\\uf L2 + i \\vf L2 
and for any S > 0, when A < cK, 

x2 



Re (A x u, u)>f (c *° Q |u W| 2 dfc + c ||«||* a - \\u\\ L . \\u n \\ L . 

J A z + (ck) 



> % \ \k\ m \u(k)\ 2 dk + c\\u\\ 2 L2 -e|H|^ - — \\uf L2 

A J\k\>K 4£ 



> min 



a 5 
2'K" 



j J \kr\u{k)\ 2 dk+{c~8-e)\\u\\ 2 L2 ~^-\\u\\ 



2 

Li • 



Thus by choosing 6, e to be small, we get the estimate ( 14. 91 ). 

To prove (14.7b . we follow the same procedures as in the BBM and RBou cases. Let 
ma € H m (R) be the solution of (_4 A — k\j u\ = with k\ e R and lim.A->o+ k\ = 
0. We normalize u\ by setting ||ua||^2 = 1. Then by ( 14. 9b , we have H^aII^- 3 ? < C and 
as before, after a renormalization u\ — > ito = u C2; in iJ . We have LimA->o+ ^ = 0, 
since 

y- ( U A i u cx) = ( ~~)~ Ux > Uc ^j = ^' ^ ~ ^ UA ' UC2; ) 

= -f(/'(«c)-M)«A ) ^ 



X-V 



-* ((/' («c) - Al)u C2; ,u c ) = - (u ca; ,u c ) = 0. 
c 

Similarly as before, we can show that u\ = c\u cx + \v\, with c\ — * 1, v\ — > —d c u c 
in "3" , when A — * 0+. In the proof, we use the facts that 

WA ^ = A Uc:r = A - X> ^' ^ ~ M ^ Ucx 

V 

■> — u c , when A — > 0+, 



A-X> 

and £ Q d c u c — —u c . Now 
and 



(U\,U CX ) = C A I ^ U cx,U cx J + ( V\,U CX ) = C\h + h 



j (g) , 



) = ( (A -V) A ^' ^ ~ M ^ Ucx ' Uc *) 
^ L \ v (/' (u c ) - -M) u CXl u}j + i ((/' (u c ) - M) u ca; , u c ) 



i((£ A - - l) u c , it c ) — ► - (u c , u c ) , 
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h = 



A x - A 
X 



1 / V 



-v\,u cx I = -- 



X-V 



(/' (u c ) - M)v x ,u c 



-- ((/' (u c ) - M) d c u c , u c ) = — {cd c u c + u c , u c ) ■ 
c c 



so 



k\ cxh+h 
lim — = lim - - 

A^0+ X 2 A^0+ (u X ,U cx ) 



(d c u c ,u c ) I (u cx , u cx ) = --77/ W Ucx Wl 2 



dp_ 

dc 



5 Discussions 

(a) About the spectral assumption for Co 

When M. = — -£2, the assumption ( 11.41 that ker(£o) = {u cx } is true because 
the second order ODE Cqi/j = has two solutions which decay and grow at infinity 
respectively, and thus u cx is the only decaying solution. Moreover, the solitary waves 
in such case can be shown to be positive and single-humped. Thus by the Sturm- 
Liouville theory for second order ODE operators, n~ (Co) = 1 since u cx has exactly 
one zero. The proof of ( 11.41 ) for nonlocal dispersive operator M. is much more delicate. 
In (J21, 0), ( 11.41 i is proved for solitary waves of some KDV type equations, such as 
the intermediate long-wave equation (|29|) with 

f(u) = u 2 anda(fc) = fccoth (kH) - H' 1 . 

The assumption ( 11.4b is related to the bifurcation of solitary waves, in the sense that 
ker£o = {ii cx } implies the nonexistence of secondary bifurcations at c, that is, the 
solitary wave branch u c (x) is locally unique. Even in cases of multiple branches of 
solitary waves, i 1.41 ) is still valid in each branch. We note that kcr £0 a ls° monitors 
the changes of nT (Co) when c is changed. For example, when (11.41 ) is valid in a 
certain range of c, n~ (Co) must remain unchanged in this range. Since otherwise, by 
continuation there is a crossing of eigenvalues through origin at some c, which increase 
the dimension of ker £o-This observation has been used in some problems (J3], ll37lD 
to get n~ (Co) for large waves from small waves for which rT (Co) is computable. At 
secondary bifurcation and turning points, the increase of ker (£0) signals the increase 
or decrease of n~ (Co) when these transition points are crossed. One such example is 
the solitary waves for full water wave problem ([37Q, for which the infinitely many 
turning points makes n~ (Co) to increase without bound by a result of Plotnikov. 
The assumption ( 11.4b is also required in all existing proof of orbital stability ( ll22l . 

M, ED). 

(b) The sign-changing symbol 

We assume a (k) > in our proof of Theorem[T] The proof can be easily modified 
to treat sign-changing symbols. Let —7 = inf a (k) < 0. Consider solitary wave 
solutions of KDV, BBM, and RBou type equations with 

c>7, 1 — - > 7 and 1 — \ > 7 (5.1) 

c c z 
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respectively. The condition (15. lb on c is to ensure that the essential spectrum of Co lies 
in the positive axis, which is required to get decaying solitary waves, such as in [7 1 and 
[6| for fifth order KDV and Benjamin equations with a (k) = — k 2 + 5k 4 and — \k\ + 
Sk 2 respectively. Denote M. to be the multiplier operator with the nonnegative symbol 
a (k) = a (k) + 7. The proof of Theorem Q] remains unchanged, by replacing A4 
with M. — 7 and using the nonnegative symbol a (k) in estimates. The same estimates 
still go through because of the condition ( 15.1b . For sign-changing symbols, the solitary 
waves might be highly oscillatory in some parameter range (Q, (6]). It is conceivable 
that such oscillatory waves are energy saddle with n~ (Co) > 2, whose stability can 
not be studied by the traditional energy minimizer idea. Theorem Q] gives a sufficient 
condition for instability in such cases. 

(c) Comparisons with the Evans function method 

In (43), Pego and Weinstein use the Evans function technique to obtain the insta- 
bility criterion dP/dc < for the case M. = -™ In their paper, the eigenvalue 
problems (12.4b . ( 13.3b and ( 14.3b are written as a first order system in x, depending on the 
parameter A. The Evans function D (A) is a Wronskian-like function whose zeros in 
the right half-plane correspond to unstable eigenvalues, and it measures the intersection 
of subspaces of solutions exponentially decaying at +00 and —00. This method was 
first introduced by J . W. Evans in a series papers including [21 1 and further studied in 
[ 1 1 . In [43], it is shown that D (A) > when A > is big enough, D (0) = D' (0) = 
and 

D" (0) = sgn dP/dc. (5.2) 

If dP/dc < 0, then D (A) < and a continuation argument yield the vanishing of 
D (A) at some A > 0, which establishes a growing mode. A similar formula as (15.2b is 
derived in |[T8l . for problems which can be written in a multi-symmpletic form. How- 
ever, there are several restrictions of the Evans function method: 1) Only the differen- 
tial operators, that is, with polynomial symbols, can be treated, since the eigenvalue 
problems need to be written as a first order system. 2) The solitary waves must have 
the exponential decay. Moreover, certain assumptions for eigenvalues of the asymp- 
totic systems are required in constructing the Evans function ( 11431 (0.6), (0.7)]). Such 
assumptions need to be checked case by case, and their relations to the properties of 
solitary waves are not very clear. By comparison, our approach apply to very gen- 
eral dispersive operators, in particular, nonlocal operators. We impose no additional 
assumptions on the solitary waves. For example, we allow slowly decaying, highly os- 
cillatory or non-symmetric solitary waves. Our only assumption (11.4b is closed related 
to the bifurcation of solitary waves, and it appears to be rather natural in the stability 
theory. Moreover, the Evans function method can only be used for the one-dimensional 
problems, since otherwise the first order system can not be written. Our approach has 
no such restriction and might be useful in the multi-dimensional setting. 

Lastly, we note that in Theorem Q] the instability is determined by both the sign of 
dP/dc and the oddness of n~ (Co). The later information seems to not appear in the 
Evans function method ( 11431 . lfT8l ). When Ai is a differential operator and n~ (Co) is 
even, suppose the Evans function can be constructed and the formula (15.2b is shown, 
then the instability criterion would be still dP j dc < 0, which is different from the 
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instability criterion dP/dc > by TheoremQ] It would be interesting to clarify this 
issue. On possible such example is the oscillatory solitary waves (|7|) of the fifth order 
KDV equation. 

(d) Some future problems 
There are several open issues from our study. 

(i) When the instability conditions in Theorem Q] are not satisfied, the stability of 
the solitary waves is unknown, except for the case when n~ (Co) = 1 in the KDV and 
BBM case. Such solitary waves are energy saddles of an even negative index, whose 
stability is very subtle and not resolved even for the finite dimensional Hamiltonian 
systems. One might need to look for the oscillatory growing modes in such cases. 

(ii) The nonlinear stability of solitary waves of energy saddles type is entirely open. 
This problem is important because of its direct relevance to the full water wave prob- 
lem. Theorem 12 might be useful to study spectral stability as a first step. To apply 
it, one need to understand when the oscillatory instability can be excluded, which is 
related to (i). 

(iii) Can we get nonlinear instability from linear instability, in the L 2 norm? This 
problem is open, even in the KDV and BBM cases where the nonlinear instability in the 
energy norm has been proved (03), ll23l ). This problem is also relevant to full water 
waves and other problems for which the blow-up issue is concerned. The L 2 instability 
results could be used to distinguish the large scale instability of basic waves from the 
local blow-up instability due to the structure of the models. 



6 Appendix 

In this Appendix, we describe a different approach than [14| and |48| to get nonlinear 
instability for some dispersive wave models. In [ 14| and |48 1, the Liapunov functional 
method of [22 1 is extended to get nonlinear instability of solitary waves of KDV and 
BBM type equations, under the assumptions dP/dc < and (11.5b . For the KDV case, 
the Liapunov functional constructed in 1 14) becomes 

A(t) = I Y (x- x(t))u(x,t)dx, (6.1) 

where Y (x) — y (z) dz and y (x) is an energy decreasing direction under the 
constraint of the constant momentum Q (u). By using the fact that the solitary wave 
considered is an (constrainted) energy saddle with negative index one, it can be shown 
(ED) that A' (t) > S > in the orbital neighborhood of the solitary wave. The 
nonlinear instability would follow immediately if A (i) is bounded, as considered in 
the abstract setting of [22J. However, A (t) defined by ( 16.11 ) is not bounded because the 
function Y (x) is not in L 2 if J y dx 0. To overcome this issue, in [14] it is shown 
that A(t) < C (1 + t v ) with some r\ < 1, then the nonlinear instability still follows. 
Such an estimate is obtained by showing that the maximum of the anti-derivative of 
u (x, t) has a sublinear growth. The same approach is used in 11481 . Il40l and ll20l (for 
KP equations), and the sublinear estimates are sometimes highly nontrivial to prove. 



28 



Below, we show that such an estimate can be avoided by using another approach, which 
was first introduced in 1 3 1 1 for a Schrodinger type problem. 

The idea in iTJTl is to make a small correction to the (energy) decreasing direction 
y (x) used in constructing the Liapunov functional A (t). The new direction, still de- 
creasing, has the additional property that its integral over R is zero. Then the new 
anti-derivative Y (x) G L 2 and thus A (t) is bounded which implies nonlinear instabil- 
ity. The correction is through the following lemma, which is a generalization of I13T1 
Lemma 5.2]. 

Lemma 6.1 For any r(x) ^ £ L 2 (R), c € R and m > 1, there exists a sequence 
{y n } in H m (R.) such that 



(1 + \x\)y n (x) e L X (R), J y n (x) dx 



tin 



in H" 2 (R) and (y n , r) = 0. 



Proof. We choose (p(x) S Cq° (R) such that J ip(x)dx = c. We claim that: 
there exists ip(x) 6 Cq°(R) such that (tp m , r) ^ 0. Suppose otherwise, for any ip(x) € 
C^°(R 1 ), we have (ijj x ,r) = O.Then r x = in the distribution sense and thus r 
constant. But r E L 2 , so r = 0, which is a contradiction. Define 

1 x 

y n = -tp(-) - a n ip x (x), 
n n 



with 



Then (y n ,r) = and 



\a n \ < 



\^)M\r\\2 



when n — > oo. Let y>„ (x) = tp(-), then 
1 „ „a 1 



0. 



V) 

n n 



n n z 



= - f L 2 

L 2 n L 



,m+l 



— > 0, when n — > oo, 

where in the above we use the scaling formula 

1 



D|^„(z) = ^(|£>|M (-) 
n 2 \ J \nJ 



as in the proof of Lemma l2.3l Therefore, y n — > in iJ 3 (R), (1 + |x|)y„ S -L 1 and 



y n (x)dx = I — </?(— = / ip(x)dx = c. 
' n n ' 
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The lemma is proved. I 

We start with an (constrainted) energy decreasing direction y (x) with (l+|a;|)y(x) S 
L 1 , that is, 

(Hy,y) <0and (y,Q' (u c )) = 0, 

where H is the second order variation of the argumented energy functional, for which 
the solitary wave is a critical point. Let TJtt to be the energy space, that is, m is the 
power of the operator H. Choosing c — J y dx, r = Q' (u c ) in the above lemma, 
we get a sequence {y n } € H rn with the properties listed in the lemma. Defining 
y n = y~y n , then we have 

(1 + \x\)y n (x) € L 1 , (y n ,P' (u c )) = 0, / y n dx = 

and (Hy n , y n ) < when n is big enough. Thus for large n, the function y n is a new 
(constrainted) energy decreasing direction with zero integral. The Liapunov functional 
A (t) is defined as in ( 16. U by using this new direction y„. By lfl4l p. 409], Y" (x) — 
f_ y n (z) dz is in L 2 , thus A (t) is bounded and the nonlinear instability results. 
Above approach has the following physical interpretation: if a solitary wave is not an 
energy minimizer under the constraint of constant momentum, neither is it even under 
the additional constraint of constant mass. This rather general idea could be useful in 
proving nonlinear instability of (constarinted) energy saddles with index one, for other 
similar problems. 
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